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SEARCHING TOOL AND PROCESS FOR UNIFIED 
SEARCH USING CATEGORIES AND KEYWORDS 

This application claims the benefit of priority of EPO application Serial No. 

004023 1 1.5. filed August 18. 2000, and entitled Searching Tool And Process l-'or 
Unified Search Using Categories And Keywords. 

Field of the Invention 

The invention relates to the field of information retrieval, and more specifically 

to displaying results to a search query, as well as navigating in databases and 
inputting requests to databases. It particularly applies to searches on the Internet. 
BACKGROUND OF THE INVENTION 

Throughout the present specification, the word "site" or "internet site" refers to 

a number of documents connected by links, with a given entry point. A directory is 
the result of indexing a number of sites or documents and of classifying these into 
categories; categories are therefore subsets of the directory, which are usually 
defined in a manual operation; — stteh operation. Such categories are often 
e-rganised organized in a tree to facilitate navigation among categories; one may also 
use categories organised organized in a directed acyclic graph, that is a graph with a 
plurality of paths to the same category. A search engine is a tool for searching among 
documents, usually embodying automatic indexing of the documents. 

A number of searching tools exist for searching and retrieving information on 

the Internet. Alta Vista Company proposed an Internet search site- with a request box 
where the user may input keywords for retrieving information. The language of the 
search may be restricted. A box is provided;- allowing provided t hat allows the user to 
select related searches; the related searches actually display phrases or sequences of 
words, which contain the current request as a substring. For instance, if the request 
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inputted by the user reads: /greenhouse effect/ (in the rest of this specification, the 
request will be marked by If), related searches could offer the following choices: 

the greenhouse effect, 

w hat is the greenhouse effect, 
enhanced greenhouse effect. 

There is also proposed a search among site categories-; this categories. 

Such a search is actually an independent category search in a separate database. 

The results of the search are displayed to the user under the list of related searches. 

The results are displayed as a list of documents or sites. 

Another Internet search site is proposed by Yahoo ! Yahoo!. Inc. There is again 

provided a request box. Results of a search inputted to the request box are displayed 
in several sections. The first section displays the category matches, together with the 
path to the matches in the category tree, while the second section displays site 
matches. The third section displays web pages. 

With the same example of /greenhouse effect/, the first category match is 

"global warming''.- warming." The path to "global warming" in the category tree is 
Home > Society and Culture > Environment and Nature. There may be provided 
several paths to the same category; ■■in category. In the example of /greenhouse effect/, 
the category entitled "global warming" appears in five different paths. Selecting a 
category in the first section allows the user to access the contents of the category. 

The second section displays site m atches; matehcs matches. Matches are 

clustered according to their categories. The third section displays web pages, together 
with a summary and anaddrcss. 

Google Inc address. Google. Inc. also provides an Internet site for search among sites 
and categories. The results of a search contain an indication of the classification of 
sites and categories. When inputting the keywords for a search, some words may be 
excluded. Selecting the category search provides the user with a list of categories that 
may relate to the search; the contents of each category may later be accessed. In the 
example of the /greenhouse effect/ search, categories CQmprise inclu.de Society / 
Issues / Environment / Climate Change. 

A.V. Leouski and W. Bruce Croft-, An Evaluation of Techniques for Clustering 

Search Results, CIIR Technical Report IR-76, National Center for Intelligent 
Information Retrieval, University of Masachussett-s Massachusetts Amherst, 
MA,U.S.A., Spring 1996, compare classification methods from Information 
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Retrieval and Machine Learning for clustering search results in a search engine. 
Apart from clustering techniques, this document discusses cluster description. A first 
method for describing a cluster consists in selecting a number of the most important 
terms from the documents comprised in the cluster, and in presenting them to the 
user. A second preferred method is to replace the important terms with important 
phrases — a phrase bein g d ef ined phrases. where a phrase is as a sequence of one or 
more words. This document provides a solution to the problem of dynamically 
clustering documents retrieved from a database by a search engine. 

US-A-5 463 773 discloses the building of a document classification tree by 

recursive optkm-satie ftopt i m i zati o n of keyword selection function. There is provided 
retrieval means for extracting keywords when a document data is inputted, and 
outputting a classification for the document data, the classification being selected 
among the classification decision tree. For extracting keywords, this document 
suggests extracting keywords defined by word sequences. A learning process is 
suggested for building automatically a document classification tree on the basis of 
the extracted keywords. 

US-A-5 924 090 proposes searching among documents, and mapping the 

keywords of the documents among static categories. Categories are therefore 
predefined in a manual process. The use of categories makes it possible to access 
documents ee niprised in the categories r included in the categories that are mapped to 
the categories. In this document, a search engine provides the results of a 
query; query, the results are mapped onto the static categories, and relevant categories 
are displayed to the user as search folders. When a search folder is selected by the 
user, the documents comprised ! n c hided in the search folder — folder, that is, the 
documents mapped onto the corresponding category — category, are displayed to the 
user. A series of search folders is displayed any time a search is carried out, the 
search folders being those static categories into which a number of documents 
retrieved were mapped. 

US-A-5 963 965 discloses a method where relevant sets of phrases are 

automatically extracted from text-based documents in order to build an index for 
these documents. These phrases are then grouped together in clusters to form a 
plurality of maps which graphically describe hierarchical relationships between the 
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clusters, and can be used to extract relevant portions of the documents in answer to 
the user selecting one of these clusters. 

US-A-5 991 756 describes a method according to which search queries may be 



where the user is presented in response with a subset of these categories which 
contain the documents relevant to the query. 

WO-A-98 49637 suggests org-aaism a organizmg results of a search into a set of 

most relevant categories. In response to a search, the search result list is processed to 
dynamically create a set of search result categories. Each of the search result 
categories is associated with a subset of the records within the search result list 
having common characteristics. Categories are then displayed as folders. 

The prior art information retrieval methods and processes have a number of 

shortcomings. Fixed or static categories actually provide a representation of the 
world - a set of documents - at a given time point and for a given field of the art. 
They may need updating, or adapting to new types of documents, when and if the set 
of documents is completed by new documents, especially by documents in a new 
field of the art. While static categories may therefore represent accurately the 
expertise of the human being who defined them, they are in fact limited to this 
expertise. In addition, any set of categories is limited by the amount of human work 
needed for completing categories and mapping entries of the database to the 
categories. 

Clusters formed of keywords may provide a dynamic vision of the word. 

However, they do not provide an easily browsable tool, and do not allow the user to 
navigate easily and freely among documents. 

Category search is Category searches are adapted to searching among 
sites. Keyword searches are more adapted to searching among separate textual 
documents. 

Therefore, there is a need for an information retrieving process and tooh that enables 
a user to navigate not only among fixed categories, but also among keywords. 



TTk? The present invention thus proposes a searching tool and process enabling its 
user to freely navigate among categories and keywords, in a friendly and transparent 
fashion. The invention combines the advantages of a set of human-made categories — 



applied to a set of documents 



l organized in a hierarchy of categories, and 



SUMMARY OF THE INVENTION 




categories, notably expertise in a given field field, together with the advantages of a 
keyword search search, notably the ability to process and handle documents outside 

of said given fteW — ; Thefield. The present invention provides a tool that is well 

adapted to searching among a database of sites and separate documents or pages. 

More specifically, the present invention provides a process for searching 

a database of entries, comprisinaincludiim the steps ef-f 

- of: a) providing a database of entries, at least part of said entries being mapped to a 
set of categories, at least part of said entries being associated with keywords; 

- keywords, b) in response to a query of a user, selecting categories among said set of 
categories according to the entries returned by said query--; 

- query, c) dynamically selecting keywords associated to the entries returned by said 
query : and 

query, and d) displaying to the user said selected categories and said selected 
keywords. 

In a particular embodiment of the process, the categories are 

or gani s ed - organized in a tree or directed acyclic graph structure. A keyword may 
preferably be a sequence of words or a sequence of stemmed words. 

Selected categories and keywords may be displayed similarly, or 

separately. 

In a particular embodiment of the process, a new query is started when a user 
activates one of said displayed categories and keywords. This step of activating may 
comprise include refining the said query of the user to the said category or keyword. 
This step of activating may also com p a s e include excluding from the said query of 
the user a displayed category or keyword. 

In another embodiment of the process, a list of entries returned by the query is 

displayed to the user. One may then display in said list a category to which at least an 
entry of said list is mapped. When the user selects this category in the list, the entries 
dincluded in the selected category may be displayed. In this case the entries 
dincluded in said category may be ranked before they are displayed. 

Additionally, when categories are hierarchically orga nise d. or gan i zed, the 

step of displaying may e ompris e include displaying categories of different 
hierarchical levels. 

levels. The invention also provides a searching tool, e empris -mg tncludirtg a 
search server for receiving queries from users and transmitting results to users, a 
database of entries, at least part of said entries being mapped to a set of categories, at 



least part of said entries being associated with keywords; wherein the search server 

ee mp rises 

-includes means for searching the database and for selecting categories among said 
set of categories according to the entries returned by said query ; 

- query, means for dynamically selecting keywords associated to the entries returned 
by said query ; 

query, and wherein the results transmitted to the users comprise said selected 
categories and said selected keywords. 

The search server is preferably a HTTP server. When the entries are textual 

entries, the database may comprise an inverted index, the categories being entries of 
said inverted index. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The features of the present invention which are believed to be novel are set 
forth with particularity in the appended claims. The invention, together with further 
objects and advantages thereof, may best be understood by reference to the following 
description in conjunction with the accompanying drawings. A search tool 
embodying the invention will now be described, by way of example only, and in 
reference to the attached drawings, where where: 

-figw e Figure 1 is a display of a searching tool according to the invention-; 

fig u re Figure 2 is another view of the display of the searching tool of figure 1, 

after the search is limited to a category-; 

figure Figure 3 is another view of the display of the searching tool of figure 1, 

after the search is limited to a keyword; 

figure Figure 4 is another view of the display of the searching tool of figure 2, 
after the search is limited to a keyword; 

■-fi gu re Figure 5 is another view of the display of the searching tool of figure 1, 
after the search is limited to a category of the list of results; 
-figure Figure 6 is a flowchart of a process according to the invention; and 
■■ figure Figure 7 is a diagram of a searching tool according to the invention. 
DETAILED DESCRIPTION OF THE INVENTION 
In this written description, the use of the disjunctive is intended to inc lude the 
conjunctive. The use of definite or indefinite articles in not intended to indicate 
cardinality. In particular, a reference to "the" object or thing or "an" object or "a" 
thing is intended to also describe a plurality of such objects or things. 
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It is to be further understood that the title of this section of the specification, 
namely, "Detailed Description of the Invention" relates to Rules of the U.S. Patent 
and Trademark Office, and is not intended to. docs not imply, nor should be inferred 
to limit the subject matter disclosed herein or the scope of the invention. 

ln_response to a query, the invention suggests displaying to the user a series of 

refinement strategies; the refinement strategies comprise relevant categories selected 
among a set of static categories. In addition, the series comprlse- s includes keywords 
dynamically obtained from the documents provided in response to the query. The 
invention allows the user to refine the search using predefined categories; in addition, 
displaying keywords allows the user to navigate more easily among the results of the 
query, without being limited to the fixed categories. 

In the rest of the specification, the invention is disclosed in reference to its 

preferred embodiment; the database covers the World Wide Web, and 
comprisesincludes Internet sites as well as Web documents. The tool according to the 
invention allows the database to be searched thanks to a HTTP server. 

More generally, the invention may apply to any database where entries are at 

least partially mapped to predetermined categories, and may be associated with 
keywords. Mapping is usually a manual operation, although it is possible to use any 
automatic process. Textual entries may easily be associated with keywords, e. g. by 
automatically indexing the entries and selecting keywords. In this case, automatic 
mapping to categories may be carried out based on keywords. 

Figure 1 is a display of a searching tool according to the invention. A request 

box 1 is displayed to the user, for inputting a number of keywords for a search or 
query; inquery. In the example of figure 1, the inputted search is again /greenhouse 
effect/. In a way known per se, the search may be limited to part of the database, in 
the example of figure 1 thanksdue to line 3. In the example of figure 1, the search is 
not limited, and the "World Wide Web" selection appears in bold on line 3. The 
"OK" button 5 makes it p ossibl e f o rpermits the user to start the search or query. 
Current The current search path is displayed to the user-; under the request bom 
tbe box. The use of the search path will be explained in reference to figures 2 and 3. 

In response to the search, a number of documents or sites are returned. 

Retrieval of deeumcnts — documents, that is. selection of sites or documents among a 
database of indexed or partially indexed documents or sites sites, may be carried out 
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in any way known pec-ser in the art. It is notably possible to use an inverted index^ 
such as the AltaVista Search Developer's Kit, sold by AltaVista Company. More 
specifically, a query inputted in the query box by the user is parsed into an internal 
representation, which is then translated into a request applied to the inverted index. 
This request is formulated according to the features supported by the inverted ifidext 
HsmWvindex. Usually supported features include ranking, boolean searches, phrase 
searches, stemming, proximity searches, etc. 

A number of these documents or sites returned by the inverted index are 

displayed to the user in response to the query. In the example of figure 1, the right- 
hand part of the lowermost section of the display provides the user with a list 7 of 
documents and sites. Together with each document, it is possible to display a 
summary of the document or site, as shown in figure L on the line immediately 
under each document or site. An icon representative of the nature of the answer may 
also be di r .pi ayed: ■ in display ed . I n the example of figure 1, icon 9 is representative of 
a document, while icon 1 1 indicates that the answer is actually a site. The address for 
accessing the document may also be displayed, as shown in figure 1 on the line under 
the summary of each document or site. When a document is part of a given category, 
this category may be displayed as well. In the example of figure 1, the sixth 
document in the list 7 of results returned by the query is entitled "Many scientists 
believe runaway greenhouse effect possible"; this possible.'' This document is 
actually referenced in the category Climate Change with the access path "Society : 
. . . : Environment : Climate Change" in the category tree. The eighth document is also 
referenced in a category. As shown in figure 1, it is possible for the user to select the 
category displayed under a result. The effects of selecting a category in the list of 
results are explained in reference to figure 5. 

It should be understood at this point of the description that the directory of 

categories in this embodiment of the invention is given as an example of predefined 
or static set of categories. In this specification and in the appended cla ims, the words 
"predefined" or "static", "static." as opposed to "dynamic" / 'dynamic." should be 
understood in that the set of categories is not amended every time a user inputs a 
query. Still, it may of course be amended to add or remove categories. 

In addition to supplying a list of documents or sites returned by the query, the 

invention suggests displaying to the user a series 13 of refinement strategies. These 
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refinement strategies comprise categories selected among the predefined set of 
categories. In the example of figure 1, categories and keywords are displayed as two 
separate lists 15 and 17, under the request box and the search path. Thus, the 
refinement strategies "Society" and "Science" in the example of figure 1 are actually 
predefined categories. 

The predefined categories may be selected in any process known per s e . Q ue 

may for in stanee to one skilled in the art. One may, for example, select the categories 
most frequently associated with the documents or sites returned by the query. In one 
way or another, a number of categories are selected and displayed to the user, in 
response to the query. 

As shown in figure 1, one may display several levels of categories. In the 

example, category "Society" is displayed with several sub-categories, viz. 
'Issues". "Issues," "Religion and Spirituality " . Spirituality . " The number of levels of 
categories displayed may be selected as discussed above, according to the number of 
documents or sites returned by the query to be found in a category. The interest of 
doing so is to guide faster the user into a relevant refinement, by skipping 
intermediate categories in the hierarchy of categories. 

In addition to selected predefined categories, the refinement strategies 

displayed to the user c ompris e includes a number of dynamically derived keywords. 
In the example of figure 1, these keywords appear in a list separate from the list of 
categories. Contrary to this embodiment, refinement strategies could be displayed 
without identifying predefined categories and dynamically derived keywords. In this 
case, the user would not distinguish between predefined categories and keywords. 
The keywords depart fundamentally from predefined categories. 

First, categories are limited in number, and are a representation of the world, at 

the time the database is built. On the contramln contrast, keywords, whateverthe 
way they are constructed, do not constitute a representation of the world, but simply 
a way to retrieve documents. In a way, they have no meaning per se and are much 
more low level than categories. 

Second, in view of this difference, the number of categories is much lower than 

the number of keywords. The number of categories is typically around thousands or 
tens of thousands; the number of keywords may amount more than the number of 
plain words in the language. Typically the number of keywords could be several 
millions or tens of millions. 
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Third, categories may not be manipulated, and the mapping of entries to 

categories does not change when a request is processed. Consequently, when a 
category is selected, all documents of the category are s e le c ted — smee sclcctcd. Since 
the category is per se a set of documents, even if it has a name for the purpose of 
displaying it to the user. In On th e oppositercontrast. keywords are objects without 
meaning that can be manipulated while formulating or refining a query. Specifically, 
when a query is refined by a category, the resulting documents are a subset of the 
category. When a query is refined by a keyword, the resulting documents need not be 
associated statically with the keyword. 

The difference between keywords and categories appears in Figures 1-5. Along 

the search, categories of the higher level disappear, as the user navigates downwards 
in the hierarchy of categories. This is the case where categories are 
organised orgamzed hierarchically, e^ e.g.. in a tree or directed acyclic graph. 

In case the invention is applied to a database of textual entries, there is 

provided an inverted index for retrieving entries. Categories are then necessarily 
entries of the inverted index, while keywords are not necessarily entries of the 
inverted index. 

For instance, assume keywords are sequences of words. The keyword "fossil 

fuels" could then be associated to every document that contains the exact sequence of 
words "fossil fuel s''. fuels," at the time the database is built. When the keyword 
"fossil fuels" is selected by the user as a refinement strategy, the query may return 
documents not only containing "fossil fuels'' , fuels,'' but also documents containing 
separate occurrences of the words "fossil" and "fuels". "fue3s." Examples of 
algorithms for processing keywords - e.g. thanks to stems or synonyms - are given 
below. 

For dynamically deriving the keywords from the entries returned by the query, 

one may use any process known per se. in the art. In this respect, the keywords may 
be comprised o f include words or a_sequence of words. As displayed in figure 1, it is 
preferred that the keywords be comprised of sequences of words. One may for 
instance, in a first phase of operation conducted prior to the queries, derive from all 
documents in the database a set of relevant sequences of words, e^gre.g.. using the 
algorithm described by Y. Choueka in "Looking for Needles in a Haystack or 
Locating Interesting Collocational Expressions in Large Textual Databases" 



(Conference on User- Oriented Oricnted-Content-Based Text and Image Handling, 
MIT, Cambridge, MA, USA, pp. 609 623. pp. 609-623. 1988). This step forms a 
database of keywords. Then, in a second phase of operation conducted in response to 
the user's query, one may dynamically extract from this keyword database the 
keywords associated with the set of documents selected by the query and select the 
most frequently appearing ones as the set of keywords to be displayed to the user. 

For enhancing retrieval effectiveness of the search engine, keywords may also 

com pri se ine hide stems (or prefixes), instead of words, or sequences of stems of 
prefixes. For instance, a stem like "telephon*" covers words like "teleph one", 
"telephones". "telephone," "telephones." "telephony" and the like. The stem "mobil*" 
covers the words ■ ' ■' mobile". "mobile." " mobi l es". "mobility ' V 'rnobiles." "mobility." 
etc. In the example of "mobile telephone", using as a keyword the sequence of stems 
"mobil* telephon*" provides a more effective use of keywords. In such a setting, a 
given keyword K is associated to a set S(K) of sequences of words. For instance, for 
the keyword "mobil* telephon*", the set S("mobil* telephon*") comprise "mobile 
teleph one", telcphone." but also "mobile telephon y", "mobile te lepho nes", "mobility 
teleph oni ng" J elephonv," "mobile telephones." "mobility telephoning." and the like. 
Each word may be automatically associated to its stem, by using the algorithm 
disclosed in M.F. Porter, An algorithm fo r suffix stripping. For Suffix Stripping, 
Programs, vol. 14 no. 3, pp. 130-137, July 1980. 

When keywords comprise stems, a document may be associated to a 

keyword K if the document contains any word or sequence of words in the set S(K) 
of the keyword K. 

At this point, one should note that the displayed keywords do not necessarily cover 
all relevant documents or sites, contrary to the suggestion of reference WO-A-98 
49637. 

T he invention thus suggests displaying to the user, in response to the query, 
selected categories as well as dynamically selected keywords. Both may be used for 
refining the search strategy, as explained now. 

The user may select one or more of the displayed categories and keywords for 

refining the search strategy. Selecting a displayed category or keyword issues a new 
query, refined by the newly selected category, or by the newly selected keyword. For 
instance, selecting the sub-category "Issues-" in the example of figure 1 would return 



the documents and sites concerning greenhouse effect and contained in the 
predetermined sub-category "Issues" of the category Society. Figure 2 is the 
corresponding display. It is similar to the display of figure 1 , sa ve f or the fa ct cxcept 
that the search path indicates that the search is limited to the category 
^^ssttesV' Issues." In addition, the documents and sites returned by the query are 
different from the ones of figure 1. Notably, the number of hits or results is 26 
instead of 839. Last, figure 2 shows that the keywords and categories are updated, 
according to the results returned by the query. Limitation through categories, as 
exemplified on figure 2, normally returns a subset of the set of hits or results 
provided by the first query. 

By selecting and displaying categories, and allowing a user to refine a query 

thanksdue to these categories, the invention makes it possible for the user to benefit 
from the expertise embodied in the predetermined categories. In addition, by 
selecting keywords and displaying these keywords, the invention avoids the 
limitations inherent to any system of predetermined categories. Categories and 
keywords are provided transparently to the user: nav igation uscr. Navigation among 
documents thus remains simple and effective, and does not require any specific skill 
from the user. 

In the embodiment of figure 1, a "minus" sign is provided in front of each of 

the keywords. In a particular embodiment of the invention, this sign is used for 
excluding from the query the corresponding keywords. For instance, in the example 
of figure 1, selecting the "minus" sign in front of "greenhouse gases" may exclude 
from the query all documents containing the keyword "greenhouse gases ". gases." 
This feature of the invention makes it possible to more easily reduce the number of 
answers, by excluding those answers containing certain keywords. Selecting the link 
to a keyword generates a new query, with thesatd keyword. Figure 3 shows the 
display obtained by selecting the keywords "fossils fuels" in the example of figure 1. 
It is again similar to the displays of figures 1 and 2. However, the search path is 
updated, as well as the list of keywords and categories. The list of results is also 
different. One should note at this point that the results obtained in such a refinement 
of the search to a specific keyword are not necessarily a subset of the results of the 
original q uem -ifldeed-,-q uery . Indeed, this may depend on the algorithms used for the 
search, and notably of the way sequences of words are handled in this algorithm. 
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For instance, assume that the user originally inputs the word /climate/ in the 

request box. The first query would then return documents containing exactly the 
word "climate". Assume the user then selects a refinement strategy, e.-g. the keyword 
"fossil fuels" among the list of keywords: ih e keywords. The reformulated query may 
then be /climat* fossil* fuel*/, where "climat*" is the stem for "climate". "climate." 
"fossil*" is the stem for "fossil" and "fuel*" is the stem for "fuels". Contrary to the 
original query, which only returns documents containing the exact word "climate", 
the refined query can return documents containing, e.g., " c 1 i matic ■■" . " cl i mat to , " but not 
the exact word "climate" ."climate." In this example, words inputted by the user are 
replaced by their stems only when the query is refined. The interest of doing so is 
that replacing words by their stem in user quer ies — queries, which is a form of query 
generalisation or query expansion expansion, increases the number of results. If it is 
carried out at a time the query is not precise enough, the search engine may return 
too many irrelevant documents; the invention therefore suggests only performing 
stemming at some point of the refinement process. One may chose to do so after a 
given number of refinements. 

Note that the same argument applies to refinement by eatege-r-kfn- 

re fl nement cate go r i cs . R efinement by a category may indeed return more documents 
than the original query, inasmuch as this query was extended by stemming. However, 
the refinement by category does provide a subset of the stemmed query. 

In this example, it appears clearly that the documents returned after the query is 

refined are not necessarily associated to the keyword "fossil fuels" . fuels." The exact 
way keywords are handled depends on the inverted index used to retrieve documents. 

It is also possible to allow the user to select more than one category or one 

keyword as a refinement strategy. Selecting several refinement strategies at the same 
time may allow the user to restrict the number of documents more easily and faster. 
Figure 4 is a display obtained by refining the search to the keyword "C02 emissions" 
in the display of figure 2. The number of results returned is km — 6 in the ex ample— 
tIow. six in the example. In this case, it is possible, as exemplified on figure 4, to 
display the list of documents or sites, without any further categories or keywords. 
This applies notably where the number of results is less than 10, under the 
assumption that the user may easily browse all the answer ^ answ ers. and need not 
restrict the number of hits. 



44* 



In figures 3, 4 and 5, the search path provides links to previous keywords or 

searches. For instance, in figure 4 or 5, the user may select "Issues" in the search 
path, and get back to the display of figure 2. 

Figure 5 is another view of the display of the searching tool of figure 1 , after 

the search is limited to a category of the list of res ults; s p eci feally rresutls. 
Specifically, the display of figure 5 is obtained when the user selects the category 
"Climate Change" in the sixth result of the list of results. As explained in reference to 
figure 1, in response to a user query, documents matching the query may be returned 
to the user, together with a description and, when available, the categories in which 
this document is classified. When the user selects on one of these categories in the 
list, the search engine initiates a new search and displays all documents contained in 
the category. Preferably, the documents are ranked or sorted according to the request 
box. In the example of figure 5, category "Climate Change" eompriuesmcludes 122 
documents, all of which are displayed in the list of results. The search path shows the 

path to the category. Sub cat egories ttertr-is Sub-categories. that is, categories 

referenced in the "Climate Chang e" ca tegor y Chanae." are displayed. 

Selecting a category in the list of results thus allows the user to navigate in all 

the documents of the category while maintaining the focus on its initial query — 
query, in view of the query being displayed in the display box, and possibly used for 
ranking documents. This capability allows the user to widen its search to documents 
related to the one that has been found without loosing the focus of its se-tffefc 
i asearch. In addition, the same navigational tools as before are used, namely, 
subcategories and keywords. This embodiment may be carried out by using a pure 
ranking mechanism for queries: noqueries. No boolean filter is used, except for 
selecting the category being visited, while navigating in a category. 

Figure 6 is a flowchart of a process according to the invention. In the first step 

20, there is provided a database, that is a set of e nt ries entries, such as documents or 
sites. Each entry is associated with zero, one or more keywords. 

The database being provided, there is provided at step 22 a set of categories. As 

discussed above, the set of category is a "static" set. It is advantageous that the 
categories be organ i sed i n a tree struct ur&r organized in a tree structure for ease of 
navigation among the catego ries: however. categories. However, this is by no means 
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a requirement of the invention. A directed acyclic graph may be used, or even any 
type of suitable graph. Entries are then mapped to categories. 

At step 24, the user inputs a query - "greenhouse effect" in the 

embodiment of figure 1 . 

At step 26, the results of the query are returned by the search engine. They 
may be displayed to the user. 

At step 28, the results of the query are analyscdanalvzcd for selecting at least 
one category. The categories are then displayed to the user. 

At step 30, the results of the query are analy s ed. analyzcd, and keywords are 
dynamically retrieved. These keywords are then displayed to the user. 

At step 32, selected categories and keywords are displayed to the user, as 
shown at 13 in figure 1. 

At step 34, the user selects one or more of the displayed categories and keywords. A 
new query is defined at step 36. The query is applied to the database, and the process 
may actually go back to step 26. In this manner, new results may be displayed, 
together with newly selected refinement strategies. Refinement strategies do not only 
provide restriction of the results obtained in a previous query, but may also provide 
new results. The search may thus be extended to other more relevant keywords and 
retrieve more relevant documents or sites. 

The invention may be carried out as follows, in the example of a database of 

textual entries, using sequences of words or stems as keywords. The entries may 
e em pri s eine lude documents, or sites. 

Four databases are set up to store respectively the inverted index of the 

documents words, the keywords associated with the documents, the categories 
associated with the documents and a summary of each document comprising for 
instance the document's address on the Internet and its few first lines. All four of 
these databases may be for instance feafoedrealized using the AltaVista Search 
Developer's Kit augmented with a driving program realised in the C language. 

Note that implemented may choose to integrate all four databases into a single 

database, or that there could also be an inverted index and another database holding 
both the categories, the keywords, and the summaries, this database being a very 
simple array of records indexed by the document identifiers returned by the inverted 
index. 



A n indexing phase is first carried eut: cach out. Each of the documents is in 
turn parsed into a sequence of words; in the case stems are used, each word is 
associated to its stem by the algorithm described above. Using a hash table data 
structure, each word/stem pair is then turned into two integer numbers, a word 
identifier and a stem identifier. Then, assuming that keywords K are specified, e.g., 
as sequences of stems "SI ... &ASn." as described above, using another hash table, 
the document is associated to the keywords K such that the sequence "SI ... Sa^Sn," 
appears in the document. This being done, words, stems, and keywords are used to 
populate the four databases using the methods described abo v e; theabove. The words 
forming the document are added to the inverted index, together with their stem, the 
categories possibly associated with the document are added to the category database 
and to the inverted index, the keywords associated to the document are added to the 
keyword database (in full or in part), and a summary is built for the document and 
added to the summary database. Note that the classification of a document into a 
category is done manually once and for all, whereas the extraction of keywords from 
the documents is entirely automatic. Also, note that there is no need to add keywords 
to the inverted index, due to the difference in treatment between categories and 
keywords, as described above. For instance, assuming the refinement consists in 
returning only documents that contain the exact keyword "fossil fu e ls ", fuc3s." one 
may do so by having the inverted index return only entries containing the word 
"fossil" immediately followed by the word ^iek , M : t his " fuels." This type of feature is 
typically provided by modern inverted indexes, such as the one suggested above. In 
this case, "fossil fuels" need not be added to the inverted index as a separate or 
atomic entry. 

A HTTP server is then set up in order to serve user queries over the Internet. 

One ma y for i ns tanc c mav. for example, use the Apache HTTP server. 
A specialised A specialized extension module is added to this HTTP serverr-m 
e*4e? to carry out the processing associated to the users' queries. This extension 
module ma y for instance be realis ed may. for example, be realized using the C 
language and the Apache API, or using the Perl language and the modjperl Apache 
module, or the Java language and the JServ Apache module. The 
sp e eialis ed specialized module carries out the process of the invention. In answer to a 
user's query, the module first contacts the inverted index database in order to retrieve 
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a ranked set of documents satisfying the query. The module then contacts all three 
other databases in order to retrieve the categories, keywords and summaries 
associated with these documents. 

The module is then able to carry out the keywords and categories selection 

processes described a bove : once above. Once the relevant categories and keywords 
are selected, they are combined with the resulting documents for building the HTML 
answer page to be returned to the user by the HTTP server. 

Figure 7 is a diagram showing a searching tool according to the invention. It 

shows a computer 40, which represents a user access to the tool. In the example, the 
tool is accessed through the Internet 42. The searching tool compri s es includes a 
HTTP server 44^44, as discussed above, this above. This server receives the queries 
of the users and returns the answers as HTML documents. The searching tool also 
compri s es includes a database 4fe46. as discussed above, the above. The database 
compr ises includes four parts, namely an inverted index 48, a category database 50, a 
keyword database 52 and a summary database 54. As discussed above, in answer to a 
user's query, the HTTP server search module first contacts the inverted index 
database in order to retrieve a ranked set of documents satisfying the query; 
ttve querv. The documents may be returned simply as a list of documents Ids, as 
indicated in figure 7. The module then contacts all three other databases in order to 
retrieve the categories, keywords and summaries associated with these documents; as 
shown in figure 7, the module may simply send the document ID to retrieve the 
necessary information. 

Figure 7 further shows a crawler 56 used for referencing web servers 58. 

The crawler searches for new information available on the Internet, and updates the 

database. In the examples given above, categories have a single attri b u t e; 
mattribuie. In other words, categories are formed of a single tree. The current 
category may be embodied by a pointer in a directory of categories or by a pointer to 
one category in the graph of categories. The invention is not limited to this form of 
catego r ies: c at egories- categories. Categories could be formed of several attributes. 
For instance, assume the invention is applied to a professional directory; in directory. 
hi response to a request for restaurants, proposed categories could indicate the type 
of restaurant, the range of prices, the geographical area, and the like. These are 
independent attributes, A category may then be defined as a ordered set of attributes; 
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each attribute is selected within a directory of possible values for this attribute. The 
current category would then be embodied by a set of pointers, each pointer pointing 
out to a specific value of an attribute in the relevant directory. The use of such 
categories makes it possible to refine a search based on several criteria. 

The search may be refined independently in each attribute of a category. 

The invention was disclosed in the present description in reference to Internet 

searches, the results of the search being documents and web sites of the World Wide 
Web. The invention applies more generally to searches among any type of indexed or 
non-indexed database, provided a number of keywords may be associated to entries 
of the database. In addition, the entries of the database may be at least partially 
mapped into categories, for returning categories and allowing the user to refine the 
search. In this respect, the World Wide Web is a paradigm of a database, while 
indexed documents or web sites are paradigms of database entries. In the 
embodiment of the invention disclosed in figures 1 to 5, there is suggested to display 
a list of entries returned by the queries; the querics. The invention may actually be 
carried out without displaying this list, but simply by displaying refinement strategies 
to the user. 

Last, the invention is not limited to the description made above. Other ways of 
populating databases may be used. 

Specific emb odiments of a search tool and method according to the present 

invention have been described For the pur pose of illustrating the manner in which the 
invention may be made and used. Jt s hould be understood that implementation of 
other variations and modifications of the invention an d its various aspects wit] be 
apparent to those skilled in the art, a nd that the invention is not limited by the 
s pecific embodiments described. It is therefore contemplated to cover by the present 
invention anv and all modifications, variations, or equivalents that fall within the true 
spirit and scope of the basic underlying principles disclosed and claimed herein. 



